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(54) IMAGE PROCESSING METHOD AND IMAGE PROCESSOR 
(5 7) Abstract: 

PROBLEM TO BE SOLVED: To obtain an image processing system, like JPEG2000, for 
compressing image information by truncation of the bit plane of image information in 
which the amount of distortion of an image can be evaluated simply at a high speed 
when the bit plane is truncated. 

SOLUTION: The image processing method for compressing image information by 
truncation of the bit plane of image information comprises a step for extracting the 
number of most significant effective bits in each bit plane, and a step for determining 
the level of a bit plane being truncated based on the number of most significant effective 
bits thus extracted. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The image-processing approach characterized by having the decision 
step which determines the level of the bit plane which carries out truncation 
based on the number of said top effective bits extracted in the image-processing 
approach which compresses image information by the truncation of the bit plane 
of image information by the extract step which extracts the number of the top 
effective bits in each bit plane, and said extract step. 
[Claim 2] In the image-processing approach which compresses image 
information by the truncation of the bit plane of image information The number of 
the top effective bits in each bit plane, and the number of the top effective bits 
whose bits of the level of the next low order of the top effective bits in each bit 
plane are effective bits, The image-processing approach characterized by 
having the decision step which determines the level of the bit plane which carries 
out truncation based on the number of said top effective bits extracted by the 
extract step to extract and said extract step. 

[Claim 3] Said decision step is the image-processing approach according to 



claim 1 or 2 characterized by determining the level of the bit plane which carries 
out truncation based on said deformation amount which has the presumed step 
which presumes the deformation amount of the image when carrying out 
truncation of the bit plane based on the number of said top effective bits 
extracted by said extract step, and was presumed by said presumed step. 
[Claim 4] It is the image-processing approach according to claim 3 characterized 
by for said image information consisting of two or more components, and for said 
presumed step performing weighting for said every component, and presuming 
the deformation amount of an image. 

[Claim 5] It is the image-processing approach according to claim 3 characterized 
by for said image information consisting of two or more subbands, and for said 
presumed step performing weighting for said every subband, and presuming the 
deformation amount of an image. 

[Claim 6] It is the image-processing approach given in claim 1 which said image 
information consists of two or more subbands, and is characterized by said 
extract step extracting the number of said top effective bits for every subband or 
code block thru/or any 1 term of 3. 

[Claim 7] The picture compression method of said image-processing approach is 



the image-processing approach given in claim 1 characterized by being 
JPEG2000 thru/or any 1 term of 6. 

[Claim 8] The image processing system characterized by having a decision 
means to determine the level of the bit plane which carries out truncation, based 
on the number of said top effective bits extracted in the image processing 
system which compresses image information by the truncation of the bit plane of 
image information by extract means to extract the number of the top effective 
bits in each bit plane, and said extract means. 

[Claim 9] In the image processing system which compresses image information 
by the truncation of the bit plane of image information The number of the top 
effective bits in each bit plane, and the number of the top effective bits whose 
bits of the level of the next low order of the top effective bits in each bit plane are 
effective bits, The image processing system characterized by having a decision 
means to determine the level of the bit plane which carries out truncation, based 
on the number of said top effective bits extracted by the extract means to extract 
and said extract means. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image-processing approach 

and an image processing system. 

[0002] 



[Description of the Prior Art] As a picture compression method, JPEG and 
JPEG2000 which are international standards are known. 

[0003] Drawing 1 expresses the common image processing system which 
compresses image information by JPEG2000. If image data 1 1 is inputted into 
an image processing system 12, discrete wavelet transform is carried out by the 
transducer 13, the quantization section 14 quantizes, entropy code modulation 
will be carried out by the coding section 15, and code data 16 will be outputted. 
That is, image information is compressed from image data 1 1 to code data 16. 
[0004] In addition, "image information" shall mean the generic name of the data 
derived from the image data 11, such as changed image data besides image 
data 1 1 , quantized image data, and image data (code data 16) by which entropy 
code modulation was carried out, and image data 1 1 . 

[0005] Drawing 2 expresses the common image processing system which 
elongates image information by JPEG2000. If code data 21 is inputted into an 
image processing system 22, an entropy decryption is carried out by the 
decryption section 23, the reverse quantization section 24 reverse-quantizes, 
reverse dispersion wavelet transform will be carried out by the inverse 
transformation section 25, and image data 26 will be outputted. That is, image 



information is elongated from code data 21 to image data 26. 
[0006] The image processing system which performs picture compression, and 
the image processing system which performs image elongation are unified in 
many cases. 

[0007] Drawing 3 explains a transducer 13. In JPEG2000, generally, image data 
11 is divided into a tile 31 like drawing 3 A, and discrete wavelet transform 
(DWT) is made for every tile like drawing 3 B. Drawing shows the example which 
divided image data 11 into the tile 31 of the magnitude of 128x128. If discrete 
wavelet transform of the tile 31 of the magnitude of 128x128 is carried out on 
level 2 by the transducer 13, as shown in drawing, the wavelet multiplier data 32 
which consist of four subband 2LL, 2LH, 2HL, and 2HH(s) of three subband 1LL, 
1LH and 1HL(s) of the magnitude of 64x64, and the magnitude of 32x32 will be 
obtained. 

[0008] Drawing 4 explains the quantization section 14. Drawing shows the 
example of the formula used for quantization. In the absolute value of a, and sign 
(a), the sign of a and Q express a floor function and, as for a and b, delta 
expresses [ the wavelet multiplier quantization before and after quantization, and 
|a| ] a quantization step, respectively. A wavelet multiplier is quantized from a 



value a by this formula to b. 

[0009] Drawing 5 explains the coding section 15. Generally in JPEG2000, the 
subband 52 of the wavelet multiplier data 51 quantized like drawing 5 A is 
divided into the code block 53 if needed (about a larger subband than a code 
block, the division into a code block is needed.)- hereafter, when calling it a code 
block, the subband which is not divided into a code block shall also be included 
- the code block 53 is further divided into a bit plane 54 like drawing 5 B, and 
entropy code modulation, such as algebraic-sign-izing, is made for every bit 
plane like drawing 5 C. Drawing shows the example which divided the subband 
52 into the code block 53 of the magnitude of 4x4 (in this case, not limited to this 
magnitude although the code block is made into the magnitude of 4x4), and 
divided the code block 53 of the magnitude of 4x4 into four bit planes 54. 
Entropy code modulation of the quantized wavelet multiplier data 51 is carried 
out every bit plane 54 by the coding section 15, and, finally code data 16 is 
outputted. 

[0010] In addition, what is necessary is just to input the image data (component) 
of each color into an image processing system 12 like drawing 6 about the case 
where image data 11 consists of two or more colors, although the case where 



image data 11 consisted of monochrome so far was explained. Although 
drawing 6 A inputs the image data expressed by the RGB method as it is, it may 
be changed and inputted into other methods, such as a YCbCr method, like 
drawing 6 B. Generally in JPEG2000, the method of drawing 6 B is taken. 
Although human being's vision is sensitive to a brightness component (Y), since 
this [ its ] is not so sensitive to a color difference component (Cb-Cr), it is for 
raising compressibility by compressing Cb and Cr more rather than Y. 
[0011] 

[Problem(s) to be Solved by the Invention] As mentioned above, since the 
quantized wavelet multiplier data are divided into a bit plane and it encodes, in 
JPEG2000, compression of the image information by the cut-off of a bit plane is 
possible. For example, compression of the image information by what 
(truncation) the bit plane is omitted for from the low order side is performed. 
[0012] Therefore, although data will be omitted until it becomes desired value 
when a certain compressibility exists as desired value, when data are naturally 
omitted, image quality will deteriorate. Therefore, if which omits data when 
omitting data, which needs to detect whether image quality deteriorates. 
[0013] As this detection approach, by the approach shown by Example and 



Guideline (EG) of JPEG2000, first, the deformation amount at the time of 
calculating the deformation amount at the time of carrying out one truncation of 
the bit plane from a low order side in each code block, next carrying out 2 
truncation of the bit plane from a low order side is calculated, and the 
deformation amount when carrying out truncation of all the bit planes is 
calculated similarly. By the approach shown by EG of JPEG2000, when 
calculating a deformation amount, it decodes, where truncation is carried out 
and an error with subject-copy image data is investigated. MSE (Mean Squared 
Error) is used as an approach of investigating an error. 

[0014] Thus, by the approach shown by EG of JPEG2000, in order to calculate 
the deformation amount at the time of carrying out truncation to each bit plane, 
respectively, after even each bit brain trust has done truncation, it decodes, 
respectively, and MSE investigates an error. Therefore, in order for the 
processing time for calculating a deformation amount to become very long or to 
shorten the processing time for calculating a deformation amount, there is a 
problem that a hard amount becomes very large. 

[0015] Therefore, this invention makes a technical problem easy and the thing to 
evaluate at a high speed like JPEG2000 in the image-processing method which 



compresses image information by the truncation of the bit plane of image 
information for the deformation amount of the image when carrying out 
truncation of the bit plane. 
[0016] 

[Means for Solving the Problem] Invention according to claim 1 has the decision 
step which determines the level of the bit plane which carries out truncation 
based on the number Of said top effective bits extracted by the extract step 
which extracts the number of the top effective bits in each bit plane, and said 
extract step in the image-processing approach which compresses image 
information by the truncation of the bit plane of image information. 
[0017] In the image-processing approach that invention according to claim 2 
compresses image information by the truncation of the bit plane of image 
information The number of the top effective bits in each bit plane, and the 
number of the top effective bits whose bits of the level of the next low order of 
the top effective bits in each bit plane are effective bits, Based on the number of 
said top effective bits extracted by the extract step to extract and said extract 
step, it has the decision step which determines the level of the bit plane which 
carries out truncation. 



[0018] About invention according to claim 1 or 2, said decision step has the 
presumed step which presumes the deformation amount of the image when 
carrying out truncation of the bit plane based on the number of said top effective 
bits extracted by said extract step, and invention according to claim 3 determines 
the level of the bit plane which carries out truncation based on said deformation 
amount presumed by said presumed step. 

[0019] In invention according to claim 4, said image information consists of two 
or more components about invention according to claim 3, and said presumed 
step performs weighting for said every component, and presumes the 
deformation amount of an image. 

[0020] In invention according to claim 5, said image information consists of two 
or more subbands about invention according to claim 3, and said presumed step 
performs weighting for said every subband, and presumes the deformation 
amount of an image. 

[0021] In invention according to claim 6, said image information consists of two 
or more subbands about invention given in claim 1 thru/or any 1 term of 3, and 
said extract step extracts the number of said top effective bits for every subband 
or code block. 



[0022] The picture compression method of said image-processing approach of 
invention according to claim 7 is JPEG2000 about invention given in claim 1 
thru/or any 1 term of 6. 

[0023] Invention according to claim 8 has a decision means to determine the 
level of the bit plane which carries out truncation, based on the number of said 
top effective bits extracted by extract means to extract the number of the top 
effective bits in each bit plane, and said extract means in the image processing 
system which compresses image information by the truncation of the bit plane of 
image information. 

[0024] In the image processing system into which invention according to claim 9 
compresses image information by the truncation of the bit plane of image 
information The number of the top effective bits in each bit plane, and the 
number of the top effective bits whose bits of the level of the next low order of 
the top effective bits in each bit plane are effective bits, It has a decision means 
to determine the level of the bit plane which carries out truncation to the extract 
means to extract based on the number of said top effective bits extracted by said 
extract step. 

[0025] According to invention according to claim 1 or 8, truncation in 



consideration of the deformation amount of an image can be carried out at easy 
and a high speed. 

[0026] According to invention according to claim 2 or 9, truncation which took the 
deformation amount of an image into consideration more correctly can be 
carried out at easy and a high speed. 

[0027] According to invention according to claim 3, easy and truncation which 
presumed at the high speed and took the deformation amount of an image into 
consideration can be carried out for the deformation amount of an image at easy 
and a high speed. 

[0028] According to invention according to claim 4 or 5, evaluation of a 

deformation amount with few errors is attained more visually. 

[0029] According to invention according to claim 6, when performing truncation 

per subband, there is little computational complexity and it ends rather than it 

extracts the number of the top effective bits for every code block. 

[0030] In addition, "image information" is the generic name of the data 

(quantized wavelet multiplier data) derived from image data and image data. 

[0031] 

[Embodiment of the Invention] The gestalt of operation of this invention is 



explained. 

[0032] (Example of the gestalt of operation of this invention) Drawing 7 
expresses the example of the gestalt of operation of this invention. The picture 
compression method of this example will be JPEG2000, like the image 
processing system 12 of drawing 1 , if image data 11 is inputted into picture 
compression equipment 12, discrete wavelet transform is carried out by the 
transducer 13, the quantization section 14 quantizes, entropy code modulation 
will be carried out by the coding section 15, and code data 16 will be outputted. 
[0033] Drawing 8 A expresses what divided into the bit plane 54 the code block 
53 of the wavelet multiplier data 51 obtained by this example. In JPEG2000, 
entropy code modulation of this bit plane is carried out with three pass (coding 
pass), respectively. The group is called a layer when grouping of the coding 
pass is carried out at the cut end of arbitration. Here, like drawing 8 B, in order to 
simplify explanation, the cut end of a bit plane 54 and the cut end of a layer 81 
are made consistent. That is, I think that a bit plane and a layer are equal. 
[0034] The truncation of a layer (bit plane) is considered. 
[0035] Drawing 9 is a sectional view when cutting the code block with which 
layer division of drawing 8 was carried put by the Ath page of drawing 8 . 



Although two-dimensional must consider essentially, since it is easy, one 
dimension considers. White expresses a wattless component (invalid bit) and 
black expresses an active principle (effective bits). The condition of having 
carried out truncation of the data of drawing 9 to the layer 3 is shown in drawing 
10 . In this condition, the active principle of almost all data remains without being 
deleted. The condition of having carried out truncation of the data of drawing 9 to 
the layer 7 is shown in drawing 11 . If it is in this condition, the data more than 
one half will be lost completely. The case where truncation of the data of drawing 
9 is carried out to a layer 6 is shown in drawing 12 . If it is in this condition, it 
turns out that the top effective bits (MSB) of almost all data remain. Moreover, 
the case where truncation of the data of drawing 9 is carried out to a layer 8 is 
shown in drawing 13 . In this case, it turns out that almost all data have 
disappeared. 

[0036] Drawing 14 shows the number (Na) in each layer of distribution of MSB, 
and MSB about the data of drawing 9 . The number (Nb) in each layer of MSB 
whose bits of the level of the next low order of MSB are effective bits is shown in 
coincidence about the data of drawing 9 . It turns out by drawing 14 that many 
MSB components are distributed over the place of a layer 7. Thus, when the 



MSB component of a wavelet multiplier carries out truncation of the distributed 
layer, the distribution situation of the data of the code block about the layer will 
change a lot. That is, it is thought between change of the number of MSB when 
performing truncation of a layer, and change of a deformation amount that there 
is correlation. Change of the deformation amount of an image can be evaluated 
at easy and a high speed from change of the number of MSB when performing 
truncation of a layer using this description. For example, truncation in 
consideration of the deformation amount of an image can be carried out at easy 
and a high speed by determining the level of the layer which carries out 
truncation based on the number of MSB. Furthermore, a deformation amount 
can be presumed based on the number of MSB, and easy and truncation which 
presumed at the high speed and took the deformation amount of an image into 
consideration can be carried out for the deformation amount of an image at easy 
and a high speed by determining the level of the layer which carries out 
truncation based on this. In addition, MSB can be easily extracted from the 
wavelet multiplier data 51 at once. 

[0037] In this example, like drawing 7 , the wavelet multiplier data 51 are inputted 
into the extract section 71 from the coding section 13, and the number (Na) of 



MSB in each layer is extracted by the extract section 71. 

[0038] In this example, further, like drawing 7 , the extract value of Na is inputted 
into the decision section 72 from the extract section 71, and the level of the layer 
which carries out truncation is determined by the decision section 72 based on 
the extract value of Na. For example, establish a predetermined threshold for 
every layer and the extract value and threshold of Na about a layer 1 are 
compared, next, the extract value and threshold of Na compare the extract value 
and threshold of Na about a layer 2, and next concerning a layer 3 — comparing 
- ****** - like When the sequential comparison of the extract value and 
threshold of Na about each layer is carried out and the extract value of Na 
becomes for the first time in Layer n beyond a threshold, How to determine from 
the layer 1 to the layer n-1 as what is done for truncation (truncation of the time 
of n= 1 is not carried out) can be considered. This threshold may be made into 
the same value with all layers, and may be made into a value which is different 
with each layer. 

[0039] In this example, like drawing 7 , the extract value of Na can be made to be 
able to input into the presumed section 73 in the decision section 72, a 
deformation amount can be presumed based on the extract value of Na in the 



presumed section 73, and the decision section 72 can also determine the level 
of the layer which carries out truncation again based on the estimate of a 
deformation amount. For example, when carrying out truncation of from the layer 
1 to the layer n, total of the product of Na of each layer and the level of each 
layer is presumed to be a deformation amount (ratio). Thus, by presuming a 
deformation amount based on the extract value of Na, it becomes possible to 
reduce the amount of operations for calculating a deformation amount, and 
compaction of the processing time and reduction of a hard amount are attained. 
[0040] Although this example treated the bit plane of wavelet (it quantized) 
multiplier data, it is applicable suitably also about the bit plane of other image 
information. Although JPEG2000 was made into the picture compression 
method, this example is applicable suitably like JPEG2000, if it is the picture 
compression method which can compress the image information by the 
truncation of the bit plane of image information. 

[0041] (Example of others of the gestalt of operation of this invention) MSB has 
one half of the amount of information of the data of the bit. Here, to the waits of 
MSB occupied in all the bits of a certain image information being about 1/2 
thru/or 3/4, when the next bit of MSB is 1 (effective bits), when the next bit of 



MSB is 0 (invalid bit), the wait of MSB occupied in all the bits of a certain image 
information is set to about 3/4 thru/or 1 . If the number (Nb) in each layer of MSB 
whose bit of the level of the next low order of MSB besides the number (Na) in 
each layer of MSB is 1 (effective bits) is extracted and the deformation amount of 
an image is evaluated based on both in order to use this property, the 
deformation amount of an image can be evaluated more correctly. For example, 
one MSB whose bit of a lower level is 0 can consider how to evaluate the 
deformation amount of an image, as 1 .5 MSB whose bit of a lower level is 1 . 
[0042] Moreover, it is presuming the deformation amount of an image based on 
the number of MSB which treated no code blocks identically, but performed 
weighting for every component or subband to the number of MSB in each code 
block about presumption of the deformation amount by the presumed section 73, 
and performed weighting, and evaluation of a deformation amount with few 
errors is attained more visually. 

[0043] If truncation of a different amount to each code block in one subband is 
performed when performing truncation, distortion arises between code blocks, 
and this may serve as a distorted error and it may be visible. For this reason, 
generally performing truncation not per code block unit but per subband is also 



made. Therefore, when performing truncation per subband, the direction which 
extracts the number of MSB etc. for every subband has less computational 
complexity rather than extracting the number of MSB etc. for every code block, 
and ends. 
[0044] 

[Effect of the Invention] Thus, the deformation amount of the image when 
carrying out truncation of the bit plane like JPEG2000 by this invention in the 
image-processing method which compresses image information by the 
truncation of the bit plane of image information can be evaluated at easy and a 
high speed. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The common image processing system which compresses image 
information by JPEG2000 is expressed. 

[Drawing 2] The common image processing system which elongates image 

information by JPEG2000 is expressed. 

[Drawing 3] It is drawing explaining a transducer. 

[Drawing 4] It is drawing explaining the quantization section. 

[Drawing 5] It is drawing explaining the coding section. 

[Drawing 6] It is drawing explaining the case where image data consists of two or 
more colors. 

[Drawing 7] The example of the gestalt of operation of this invention is 



expressed. 

[Drawing 8] A bit plane and a layer are expressed. 

[Drawing 9] It is drawing of the example of arrangement of the data in a layer. 
[Drawing 10] It is drawing at the time of carrying out truncation of the low order 3 
layer. 

[Drawing 11] It is drawing at the time of carrying out truncation of the low order 7 
layer. 

[Drawing 12] It is drawing at the time of carrying out truncation of the low order 6 
layer. 

[Drawing 13] It is drawing at the time of carrying out truncation of the low order 8 
layer. 

[Drawing 14] It is drawing which extracted Na and Nb of each layer. 

[Drawing 15] It is drawing when the distribution in the space of an image is 

changing gently. 

[Drawing 16] It is drawing when two poles of distribution in the space of an image 
have specialized. 
[Description of Notations] 
11 Image Data 



12 Image Processing System 

1 3 Transducer 

14 Quantization Section 

15 Coding Section 

16 Code Data 

21 Code Data 

22 Image Processing System 

23 Decryption Section 

24 Reverse Quantization Section 

25 Inverse Transformation Section 

26 Image Data 

31 Tile 

32 Wavelet Multiplier Data 

51 Quantized Wavelet Multiplier Data 

52 SubBand 

53 Code Block 

54 Bit Plane 

71 Extract Section 



72 Decision Section 

73 Presumed Section 
81 Layer 
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